A UNITARY EXTENSION PRINCIPLE FOR SHEARLET SYSTEMS 
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Abstract. In this paper, we first introduce the concept of an adaptive MRA (AMRA) structure 
which is a variant of the classical MRA structure suited to the main goal of a fast flexible decomposi- 
tion strategy adapted to the data at each decomposition level. We then study this novel methodology 
for the general case of afnnc-like systems, and derive a Unitary Extension Principle (UEP) for filter 
design. Finally, we apply our results to the directional representation system of shearlets. This 
leads to a comprehensive theory for fast decomposition algorithms associated with shearlet systems 
which encompasses tight shearlet frames with spatially compactly supported generators within such 
an AMRA structure. Also shcarlet-like systems associated with parabolic scaling and unimodular 
matrices optimally close to rotation as well as 3D shearlet systems are studied within this framework. 
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1. Introduction. Wavelets are nowadays indispensable as a multiscale encoding 
system for a wide range of more theoretically to more practically oriented tasks, since 
they provide optimal approximation rates for smooth 1-dimcnsional data exhibiting 
singularities. The facts that they provide a unified treatment in both the continuous 
as well as digital setting and that the digital setting admits a multiresolution analysis 
leading to a fast spatial domain decomposition were essential for their success. It can 
however be shown that wavelets - although perfectly suited for isotropic structures - 
do not perform equally well when dealing with anisotropic phenomena. 

This fact has motivated the development of various types of directional represen- 
tation systems for 2-dimcnsional data that are capable of resolving edge- or curve-like 
features which precisely separate smooth regions in sparse way, of which examples 
are contourlets [19] and curvelets [10l [TTJ [12]. All these multiscale variants offer 
different advantages and disadvantages, however, neither of them provides a unified 
treatment of the continuous and digital setting. Curvelets, for instance, are known 
to yield tight frames but the digital curvelet transform is not designed within the 
curvelet-framcwork and hence, in particular, is not covered by the available theory 

About three years ago, a novel representation system - so-called shearlets - has 
been proposed [24(I38|. which possesses the same favorable approximation and sparsity 
properties as the other candidates (see (25] [22l [39]) of whom curvelets are perhaps 
the most advanced ones. One main point in comparison with curvelets is the fact 
that angles are replaced by slopes when parameterizing directions which significantly 
supports the treating of the digital setting. A second main point is that shearlets 
fit within the general framework of afnnc-like systems, which provides an extensive 
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mathematical machinery. Thirdly, it is shown in |37j that shearlets - in addition to the 
aforementioned favorable properties - provide a unified treatment for the continuous 
and digital world similar to wavelets. 

Recently, several researchers |26lBI)lHX] have provided approaches to introduce an 
MRA structure with accompanying fast spatial domain decomposition for shearlets. 
This would establish shearlets as the directional representation system which provides 
the full range of advantageous properties for 2D data which wavelets provide in ID. 
However, in the previous approaches, does either the MRA structure not lead to a tight 
frame, infinitely many filters make an implementation difficult, or the MRA structure 
is not faithful to the continuum transform. Approaches to extend the present shcarlct 
theory to higher dimensions were also already undertaken, however, for now, only 
with continuous parameters |17j . 

In wavelet theory, the Unitary Extension Principle (UEP) introduced in [42] 
has proven to be a highly useful methodology for constructing tight wavelet frames 
with an associated MRA structure in order to develop efficient algorithms, for in- 
stance, for frame based image restorations including image deblurring and blind im- 
age deblurring, image inpainting, image denoising, and image decomposition (see 

[UI2IIIlHm©0®[I3m[I3[IE])- Th6Se a PP lications of frame-based image restora- 
tions are also one motivation for our adventures here. 

In this paper we aim at providing an MRA structure for tight shearlct frames - 
and in fact even for more general aflmc-like systems encompassing different shcarlct 
systems as special cases - which exhibits all the favorable properties of MRA struc- 
tures for wavelets. We also allow the MRA structure to be more flexible in the sense 
of adaptivity than ordinarily considered in the literature. We further prove sufficient 
conditions for such an adaptive MRA in terms of a suited Unitary Extension Princi- 
ple (UEP) along with a fast spatial domain decomposition as well as approximation 
properties. Surprisingly, our general theory also includes shear let systems for 3D data 
and provides fast decomposition algorithms for those. 

1.1. List of Desiderata. The theoretical framework for a fast spatial domain 
decomposition we will develop in the case of general affinc-likc systems (cf. Subsection 
11.21 for a precise definition), and, in particular, for shearlet systems shall satisfy the 
following desiderata: 

(1) Adaptivity. The MRA structure shall allow interactive adaption of the de- 
composition procedure to different types of data cither beforehand or during 
the process. 

(2) Computational Feasibility. The MRA structure shall be suited to the fact 
that it aims for a decomposition algorithm, that means, for instance, that 
only a finite range of scales is required. 

(3) Fast Spatial Domain Decomposition. An accompanying fast transform shall 
exist which decomposes digital data into high- and low-frequency parts, in 
particular, comprising directionality behavior. 

(4) Tight Frame Property. This property will ensure stability of the decomposi- 
tion and the possibility to employ the adjoint for reconstruction. 

(5) Compactly-Supportedness. The framework shall allow the utilization of com- 
pactly supported generators to ensure spatial domain localization as well as 
fast computations, in particular, in the special case of shearlets. 

(6) Arbitrary Dimension. The framework shall be applicable to affinc-likc systems 
for arbitrary dimension. 
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(7) Faithfulness to Continuum Transform. In the special case of shearlets, the 
transform shall be faithful to the continuum transform in the sense of being 
accompanied by a continuum shearlet system with discrete parameters. 

1.2. An Adaptive Multiresolution Analysis (AMRA) for Afflne-Like 
Systems. The framework of a multiresolution analysis is a well-established method- 
ology in wavelet theory for deriving a decomposition of data into low- and high- 
frequency parts associated with a scaling function and wavelet which leads to a fast 
spatial domain decomposition. However, aiming for a decomposition with respect to 
general affine-like systems, which we coin systems being a subset of unions of affine 
systems 

U W^k : 3 eZ,keZ d ,l = i,...,r}, ^,..,f ei 2 (K d ), 

MeACGL(d,R) 

where 

ifc. k := | dot U\ 1/2 ^ l {U --k), k e Z d , U G GL(d, R), (1.1) 

we are forced to reconsider this approach. 

In light of desiderata (l)-(3) from the previous subsection and continuing the ini- 
tial observations already made by one of the authors in [33] , we claim a new paradigm 
for MRA manifested in the following two requirements to an MRA: 

(Rl) If one aims for a fast decomposition algorithm, it is sufficient to study non- 
homogeneous systems, i.e., considering a fixed finest decomposition level J 
instead of analyzing the limit J —> oo. In the same way, the coarsest level 
might be defined to be the level without loss of generality. 
(R2) It is not necessary to specify beforehand which functions or masks generate 
the low- and which generate the high-frequency parts, since the key equation 
(Unitary Extension Principle) which needs to be satisfied at each decompo- 
sition level does not distinguish between them. 
The main advantage of (Rl) is to adapt the theoretical continuum considerations to 
the implementation requirements, whereas (R2) allows us to change the composition 
of the masks adaptively at each decomposition level. Therefore we coin this new 
paradigm for MRA an Adaptive Multiresolution Analysis (AMRA). 

The decomposition technique will still rely on subdivision and transition operators 
which we in the sequel denote as follows: For arfxrf invertible integer matrix M and a 
finitely supported sequence a : 7L d — > R, the subdivision operator S a .M : l(Z d ) — > l(Z ) 
and the transition operator T a ,M '■ l(Z ) — ► l(Z d ) are defined by 

[S„ lM i>](n) := | det(M)| ^ «(k)o(n - Mk) and [T a . M v](n) := ^ «(k)o(k - Mn). 

k6Z d k<EZ d 

Note that gQjfe ) = | det(M)|£(M T £)a(0 and T^v(M T £) = | det(M)!- 1 £ ue n M 
27rw)a(£ + 2ttlo), where o(£) := £ k6 z d a(k)e" tk ' ? and Q M := [(M T )" 1 Z d ] H [0, l) d . 

We will now illustrate the general idea of an AMRA to the reader in the case of 
shearlet systems. 

1.3. Shearlet Systems. Shearlet systems can be regarded as a special case of 
the previously introduced affine-like systems. The continuum shearlet transform with 
discrete parameters [Ml I3H] for functions in L 2 (R 2 ) uses a two-parameter dilation 
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group, where one parameter indexes scale, and the second parameter indexes orien- 
tation. For each c > and s£l, let A c denote the parabolic scaling matrix and S s 
denote the shear matrix of the form 



o % ) and Ss = ( 1 , 



respectively. To provide an equal treatment of the x- and j/-axis, we split the frequency 
plane into the horizontal cone 

Co = {(&,6)GR 2 :|£i|>l, >1}, 

the vertical cone 

Ci = {(6,6)eM 2 :|6l>i, 16/61 < 1}, 

as well as a centered rectangle 

7e = {(6,6)eK 2 :!|(6,6)lloo<i} 

(see Figure 11.11 (a) ) . 





(a) 



(b) 



Fig. 1.1. (a) The cones Co and C\ and the centered rectangle 1Z in frequency domain, (b) The 
tiling of the frequency domain induced by discrete shearlets. 

For cone C\, at scale j > 0, orientation k = — 2 J , . . . , 2 J , and spatial position 
m G Z 2 , the associated shearlets are then defined by their Fourier transforms 

a r) = 1 } T-ip{SkA A] ■ -m), 

where rj = (j, k, m, l) index scale, orientation, position, and cone. The shearlets for 
C\ arc defined likewise by symmetry, as illustrated in Figure ITTTI (b). and we denote 
the resulting shearlet system by 



{ct„ : n G N x {-2 J , ,.,?}xZ 2 x {0, 1}}. 



(1.2) 



This is an affine-like system as defined before. 

Notice that we chose a scaling of 4 3 . Shearlet systems can be defined similarly for 
a scaling of 2- J , however, in this case the odd scales have to be handled particularly 
carefully. 

One particular interesting shearlet generator is the function ijj € L 2 (R 2 ) defined 

by 



<M6 = V;(6,6) = <M6)<Mf), 
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where G L 2 (R) is a wavelet with ^ G C°°(R) and supp ^ C [-4, -±] U [±,4], 

and i/'2 G L 2 (R) is a 'bump' function satisfying ip2 G C°°(R) and supp V'2 G [—1, 1]. 
Filling in the low frequency band appropriately, with this particular generator the 
shearlet system (|1.2[> can be proven (see [2U Thm. 3]) to form a tight frame for 
{/ G L 2 (R 2 ) : supp/ C Co U Ci}. We remind the reader that a system X is called 
a frame for a Hilbert space 7i (in the literature sometimes also referred to as a 
Parseval frame or a £i<?/it frame with bound one), if ||/|| 2 = X^gex K/jff)| 2 holds for 
all / G H. 

Concluding, the definition just discussed shows that shcarlets live on anisotropic 
regions of width 2~ 2 ^ and length 2 _J at various orientations, which are parametrized 
by slope rather than angle as for second generation curvelets. 

1.4. Shearlet AMRA. An intriguing application of the theory whose core ideas 
were presented in the Subsection 1 1.21 is the consideration of shearlet systems. In fact, 
this allows us to derive a framework which fulfills the desiderata we aimed for (see 
Subsection II. ip . 

The fast spatial decomposition algorithm is derived as a special case of the 
methodology we will develop for general affine-like systems. To illustrate the idea 
of AMRA in the situation of shearlet systems, we will discuss one step of the decom- 
position algorithm. For this, let Se, £ = 1, . . . , r be a selection of 2 x 2 shear matrices, 
i.e., matrices of the type Sk, k G Z, let 1 < s < r be the separator between low- and 
high-frequency part, and let ag, £ = 1, . . . , r be finitely supported masks. Further, we 
denote the given data by v which for convenience purposes we now assume to lie in 
l(Z, 2 ). Notice that certainly from the previous decomposition step we presumably have 
many such low-frequency coefficients. Retaining the notion introduced in Subsection 
11.2) we then compute the next level of low-frequency coefficients by 

vg = T ae ,s e A 4 v, £ = 1, . . . , s. 

Similarly, we compute the next level of high-frequency coefficients by 

Vg = T ae ,SeA 4 V, £ = S + l,...,T. 

The next step continues with decomposing vg, I = l,...,s. The total number of 
decomposition steps is J, hence finite. 

The reader should notice the requirements (Rl) and (R2) from Subsection 11.21 
as opposed to a 'classical MRA-decomposition algorithm'. (Rl) is the finite number 
of decomposition steps, which is a more accurate model for what truly happens in a 
numerical decomposition. It thereby allows more flexibility, since the limit J — ► oo 
doesn't need to be taken into account. (R2) can be seen by the fact that the separator 
between low- and high-frequency part is somehow 'loose' in the sense that at each level 
a certain condition needs to be satisfied (see Theorem 11.11 (i) below) , which does not 
distinguish between those parts. This also implies that the structure of the subspaces 
the data is projected onto is not that strict than for a classical MRA, but allows also 
non-orthogonality and non-inclusiveness. 

This algorithm is accompanied by a perfect reconstruction algorithm, if and only 
if, in each decomposition step the following version of the Unitary Extension Principle 
[42] is satisfied by the masks ag. For this, we have the following result, which we could 
coin the 'Shearlet Unitary Extension Principle'. 

Theorem 1.1. Let Sg, £ = 1, . . . , r be a selection of 2 x 2 shear matrices, i.e., 
matrices of the type Sk, k G 1, and let I = 1, . . . , r, be finitely supported masks. Then 
the following conditions are equivalent. 
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(i) For all v G l(Z d ), 



r 



•a^StAi^a^StAiV — V. 



1=1 



(ii) For anyujen = [f e=1 Sl 8tJU , where n SeAi ■= [(Sfy^Z x ±Z)] n [0, l) 2 , 



where 5 denotes the Dirac sequence such that 5(0) = 1 and S(uj) = for 



In Section [2J we state a general version of this result (Theorem 12. ip from which 
this theorem can be derived as a corollary. A continuum version of it will then be 
discussed in Section [3] In Section [4] we will provide a variety of different choices 
for the masks, the dilation matrices, and the direction matrices. Adapted to the 
shearlet setting, the dilation matrices will typically be parabolic scaling matrices and 
the direction matrices will be chosen to be shear matrices. 

1.5. Extensions and Further Questions. In fact, the results - including the 
general affine-like systems we claim to consider - are susceptible of extensive general- 
izations and extensions most of which are far beyond the scope of this paper and will 
be studied in future work. 

• Bi-Frame Case. The bi-orthogonal framework for wavelets typically allows 
for significantly weakened filter conditions. Also for our more general MRA- 
framework, we can ask a similar question, which is then correctly stated as 
the bi-frame case. 

• Shearlets for Higher Dimensions. Thriving applications such as the prob- 
lem of geometric separation in image processing, for example, in astronomy 
when images of galaxies require separated analyses of stars, filaments, and 
sheets call for directional representation systems for 3D data, but also even 
higher dimensions (see, e.g., [2Q1I2I])- Our framework conveys the potential 
to generate shearlets for higher dimensional signals alongside a fast flexible 
decomposition strategy, and we will present one example in 3D in Section 3J 

• Computational Realization. Certainly, one extension of the work presented in 
this paper is the algorithmic study of the algorithms presented in this paper. 
Here wc aim for understanding the additional flexibility these provide and 
how to optimally explore and utilize this property 

1.6. Related Work. Several research teams have previously designed MRA 
decomposition algorithms based on shearlets: wc mention the affine system-based 
approach [26j , the subdivision-based approach [40] , and the approach based on sepa- 
rability [41] . However, neither of these approaches did satisfy all items of our list of 
desiderata (see Subsection ll.ip . Further non-MRA based approaches were undertaken, 
for instance, in [23] . In our opinion, these pioneer efforts demonstrate real progress in 
directional representation, but further progress is needed to derive an in-all-aspects 
satisfactory comprehensive study of a fast spatial domain shearlet transform within an 
appropriate MRA framework with careful attention to mathematical exactness, faith- 
fulness to the continuum transform, and computational feasibility, ideally fulfilling all 
our desiderata. 
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A particular credit deserves the work in [40 , in which the adaptivity ideas were 
already lurking. The main difference to this paper is the additional freedom provided 
by the AMRA structure. 

1.7. Contribution of this Paper. The contribution of this paper is three-fold. 
First, we introduce the concept of an adaptive MRA (AMRA) structure suited to 
the main goal of a fast flexible decomposition strategy. Secondly, we study this novel 
methodology for the general case of afhne-like systems. And thirdly, we present a 
comprehensive theory for shearlet systems which encompasses tight shearlet frames 
with spatially compactly supported generators within such an AMRA structure along 
with a fast decomposition strategy. 

1.8. Contents. In Section [21 we introduce the notation we employ for general 
affine-like systems, state the fast decomposition algorithm based on an AMRA, and 
prove the Unitary Extension Principle (UEP) for this situation. Section[3]is concerned 
with the relation to the continuum setting, i.e., with developing characterizing equa- 
tions and approximation properties for the functions associated with an ARMA. This 
general methodology is then applied to the situation of shearlet systems in Section @J 
where we present a general construction for associated filters. Here we also consider 
shearlet-like systems in the sense of integer- valued matrices approximating rotations 
different from the customarily employed shear matrices, and an approach of detecting 
anisotropic phenomena with an astonishingly simple isotropic system. 

2. An Adaptive Multiresolution Analysis for General Affine-Like Sys- 
tems. As already elaborated upon in the introduction, one main idea of an AMRA 
is to be able to design each decomposition step adaptively, for instance, dependent 
on the previous decomposition. To follow this philosophy, in Subsection 12. li we will 
firstly analyze one single decomposition step, which might occur at any stage of the 
general decomposition algorithm. Secondly, in Subsection 12.21 we will then present 
the large picture in the sense of the complete decomposition procedure. 

2.1. A Unitary Extension Principle for One Decomposition Step. Let 

now v £ l(Z d ) be some set of data. This could be the initial data, but also data after 
some steps of decomposition then on a renormalized grid. We assume that we are 
given a sequence of arbitrary d x d matrices M^, 1 < I < r, and finitely supported 
masks ai , £ = 1, . . . , r according to which the data shall be decomposed. Our first 
result is a Unitary Extension Principle (UEP) for this situation, which characterizes 
those matrices and filters, which allow perfect reconstruction from the decomposed 
data using subdivision. 

Theorem 2.1. Let Mp, l<£<rbedxd invertible integer matrices, and let ag, 
1= 1, . . . , r, he finitely supported masks. Then the following conditions are equivalent. 

(i) For all v G l(1 d ), 

r 

^ Sa e ,M e Ta e ,M e V = V. 
i=\ 

(ii) For any lj e Q = \J r (=1 fl Mt , where Q Me ■= [(Mj )" 1 Z d ] n [0, l) d , 

3(osnr+2mj) = %). (2.i) 
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Proof. First, notice that, for all v G l{Z d ), (i) is equivalent to 

r ^ ^ 

1=1 
r 

= £ I det(M / )|T^>(Mj'Oa<(0 

£=1 
r 

i=i uef! M( 

Employing the equivalence relation given by Qm„, we can rewrite the previous equa- 
tion as 

v(0 = Yl + 2wu)ai(£)at(Z + 2-koj) for all v G l(Z d ). (2.2) 

Since (ii) implies (|2.2p , this proves (ii) => (i). 

We now assume that (i), hence (|2.2p holds. We aim to prove that this implies 
(ii). For this, we let -B e (£o) denote as usual an open ball around £ with radius e. We 
now first observe that for any qj E ft and any £ G R, there exists some v G Z(Z d ) 
and e > such that 

(a) u(£ + 2ttcj ) - 1 for all f e B e (fo), 

(b) u(£ + 2ttw) = for all £ € B e (£o), w G fi \ {w }, 

(c) suppu C 27tw + -B 2e (£ ), 

simply since f2 is discrete. Now we can conclude that (|2.2[) implies 

HO = J2 ai(i)at(£ + 2mj) for all uj G fi, £ G B e (£ ). 

Hence again by (a) - (c), condition (ii) follows for all £ G i? e (£o)- Since £o is arbitrary 
chosen, condition (ii) follows. □ 

The first part (equivalence of conditions (i) and (ii)) of the next result follows 
immediately from Theorem 12. II as a special case. It significantly simplifies the condi- 
tion on the mask imposed by the UEP, provided the situation allows to always use 
the same sampling lattice. Condition (iii) is the spatial domain expression for the 
UEP condition (ii), which illustrates the filter design problem in spatial domain. Cer- 
tainly, this condition could also be stated in the general situation of Theorem 12. 11 
We however decide to omit this, since the content would be clouded by very technical 
details. 

COROLLARY 2.2. Let M^, l<£<rbedxd invertible integer matrices satisfying 
that MiL d = M1* d for all 1 < I < r for some matrix M, and let ae, £ = 1, . . . ,r, be 
finitely supported masks. Then the following conditions are equivalent. 

(i) For all vel(Z d ), 

r 
1=1 

(ii) For any u G Q M = [(M T )" 1 Z d ] n [0, l) d , 

r 

^ oH£)a}(£ + 27ra;) = S(uj). 

i=i 
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(iii) For all k, 7 G V 1 , 

^2 flf(k+ Mn + 7)a^(Mn +7) = | dct(M)| _1 (5(k). 

n<=Z 2 

Proof. As already mentioned, the equivalence of (i) and (ii) does follow from 
Theorem O 

We next prove equivalence between (ii) and (iii). By using the definition of ag, 
condition (ii) is equivalent to 

S(u) = E E ^y k< E ^(n)e-' ln ^ +2 ™ ) 

r 

= E E o^0<Mn)e !(k " nH e- ln - 2 ™ . (2.3) 

C=l k,nGZ d 

Next wc denote T M = Z d /[MZ d ] with G r M . Then 

Z d = T M + MZ d 
follows directly. This now allows us to rewrite (|2 .3[) as 



5 H = EE E a<(k)a/(Mn + 7 ) 

f=i 7 er M k,nez d 



i(k— Mn — 7)-4g— i(Mn+7)27rw 



vk,n<EZ d I , cr 

' 761 u 



= EE E afC<+Mn + 7)af(Mn + 7)e ik -«e- i7 - 27rw . 
Considering this equation in matrix form 

(e" lT2 n^er M ( E ^(k + Mn + 7 )o,(Mn + i)e**) = (f W) wg0l , 
we can conclude by taking the inverse that 

a e (k + Mn + 7)o^(Mn + 7)e ik? 
|det(M 1 )r 1 (e^' 2 ™) c0 (tffu;)) c0 

1 



= I detCr 



1-1 



1 

Thus (ii) is equivalent to the equation 

M k + Mn + 7M Mn + 7)e lk ' C = Idet^r 1 for all 7 G Z d , 

k,n6Z d 

which in turn is equivalent to (iii). □ 
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This corollary implies, by defining the equivalence relation ~ on the dx d invertiblc 
integer matrices by 

M ~ M' :<<=>. MZ d = M'Z d , 

that only one representative of each involved class needs to satisfy (|2.1[) . In other 
words, only the generated lattices MZ d do matter in the condition equivalent to 
perfect reconstruction. Inside each class we have very much freedom to choose the 
dilation matrices as necessary by the application. We refer the reader to for the 
application of this observation on the construction of wavelets. 

2.2. Fast Decomposition Algorithm. In the previous subsection, we derived 
characterizing conditions for sequences of arbitrary d x d matrices M^, 1 < I < r, and 
finitely supported masks at, I = 1, . . . ,r which allow perfect reconstruction in each 
step of an AMRA. This now enables us to present a general adaptive decomposition 
algorithm, where the matrices and masks in each step can be chosen according to 
Theorem O 

We first require some notation to carefully keep track of the decomposition steps 
and positions in the generated tree structure by suitable indexes. While reading the 
definitions, we recommend the reader to also take a look at Figure l2~Tl which illustrates 
the indexing of the decomposition. The heart of our indices are vectors {fix, . . . ,/3j) 
assigned to matrices, filters, and data, where each entry /3j indicates whether this 
object is related to the computation of scale j or a coarser scale, and if yes, whether 
the data at scale j to reach this object was generated by a low-pass or high-pass filter. 

Let us now be more specific. The original data is assigned the index := 
(0, . . . , 0) G Nq , and we set = {0} = {(0, . . . , 0)}. For the indexing of the low-pass 
filters, we define Iq = {1, . . . , sq} and, for the high-pass filters, Tq = {so + 1, . . . , Vq}, 
where so < ro and ro is a positive integer. In that sense sq partitions the filters into 
low- and high-frequency filters. If so = ro, then Tq = 0. Thus, matrices and filters 
in the first step of the decomposition are labeled by (£, 0, . . . , 0) G Nq , felg for the 
low- frequency objects, and (£, 0, . . . , 0) G Nq , t G Iq for the high-frequency objects. 
For our convenience, we further introduce the notation 

£f = 4 o = {(f,0,...,0)eR J :fel^} 

and 

£f = £" = {& o, . . . , 0) G R J : £ G Ig} 

to denote the indices for the low- and high-frequency objects in the first decomposition 
layer. The associated filters ap,f3 G C\ U Ci for the first decomposition step arc 
required to satisfy condition (ii) in Theorem 12. 11 i.e., 

S~] a^(£)as(£ + 27rw ) = ^M? we!lo=%..,o), 

/3G{ 7 e£fu£f : ^GOm 7 } 

where M 7 are d x d invertiblc integer matrices, Om t := [(M^) _1 Z d ] n [0, l) d , and 
^(o,...,o) : = U 7e£ t u£ H Qm t - 

The matrices and filters which are used in the jth step will then be labeled as 
follows. We first assume that in the (j — l)th step the sets and were already 
constructed. Then, for some j3 = (/3i, . . . , fy-i, 0, . . . , 0) G we define 



lp ={1, ...,sp} and if = {sp + l, ...,rp} with 1 < sp < rp, 
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as single labels in the new decomposition layer for the matrices and filters. To take 
the whole tree structure into account, we now define the set of new low-pass related 
indices arising from /3 = (Pi, ... , /3j-i, 0, . . . , 0) by 



4/3 = {(ft. 



,/V 1; £,0,...,0)GN 7 :£e^} 
and the same for the set of all high-pass related indices, 

cf p = m, . . 1,0, . . . ,o) € n j : e G 

We further set 



cr = u 



and £f = U 



£ 



the complete set of low-pass and high-pass indices in step j, respectively. Now let 
q e £j_i- To ensure perfect reconstruction, according to Theorem 1 2. 1[ the associated 
filters ap, (5 G £^ Q U Cf a must satisfy 



0e{-ye£j >a u/:f ia ■. wgo M7 } 



u 7 e,c£ a u,CjF, 



where f2 c 

Next we describe the general multi-level decomposition algorithm explicitly using 
the indexing that we just introduced. For illustrative purposes, before presenting the 
complete algorithm, we display the first decomposition step as well as one part of the 
second decomposition step in Figure 




'(s o +l,0,...,0) 



I 



'(s +2,0,...,0) 



• * • 



_L 



'(r ,o,...,o; 




{"/3 =TggMg"(2 ,0, ...,0) ; g g £ "(2,0„ . . ,0) = 1(2. 0. ■ ■ ■ . °) : * <j 0) } 



=T a/3 , Mg i-(2,0,...,0) : ^ £ £ 2,(2,0,...,0) = { (2, 0, ■ ■ ■ , 0) ' * £ Z (2 ,0, . . . ,0) > 



I 



T 



I 



Fig. 2.1. TTte decomposition structure of (FAD) illustrated through the first complete step 
and the second step shown exemplarily through the decomposition of f(2,o,...,0) ■ The low-freguency 
components, which will be processed further, are gray-shaded. 

In Figure 12.21 we now describe the general multi-level decomposition algorithm 
explicitly This decomposition can be implemented as the usual fast wavelet transform 
with a tree structure. We remind the reader of the introduced notion of transition 
and subdivision in Subsection 11.21 
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FAD (Fast Adaptive Decomposition) 

Parameters: 

• Data v el(Z d ). 

• Number of iterations JgN. 

• Set of all indices C := |j/ = i Cf U U/=i £f ■ 

• Number of decompositions rp for each position j3 <G J ' = 1> • • • j J- 

• Separators between low- and high-pass parts sp < rp for each position 
pe£f_ 1 ,j = l,...,J. 

• Sequence of finitely supported masks ap G i(Z ), /? € £, satisfying the 
conditions in Theorem 12. II 

• Sequence of matrices (Mp)p e c satisfying the conditions in Theorem 1 2. 11 
Algorithm: 

1) Set v = W(o,...,o) = v. 

2) For j = 1,...,J do 

3) For /3 G £f >a , ol G jCj'-i do 

4) Set vp = T afjtMl3 v a . 

5) end; 

6) For /? e £f aJ a G £jLi do 

7) Set = T a(3jM/3 Va- 

8) end; 

9) end; 
Output: 

• Low- pass coefficients vp, where /3 E Cj. 

• High-pass coefficients wp, where /3 G U/=i ^j 1 ^- 

Fig. 2.2. T/te FAD Algorithm for a fast adaptive decomposition using affine-like systems. 

The fact that the filters are chosen to be perfect reconstruction filters allows us to 
reconstruct the data by application of appropriate subdivision operators as displayed 
in Figure HO 

3. Relation with Continuum Setting. We next intend to relate the 'digital 
conditions' on the filters to 'continuum conditions' for associated function systems, in 
particular, frame systems. 

3.1. Characterization Equations. As before in Theorem[2T] we only consider 
one level. The conditions we will derive then need to be satisfied for each step in the 
iteration, and the choice of a non-stationary or stationary scheme is left to the user. 

For a function <j> and invertible d x d matrix U, we shall use the notation as in 

m- 

We can now formulate the condition on prefect reconstruction in terms of a con- 
dition in the function setting. Notice that here we again consider the most general 
situation of Theorem 12. II as opposed to Corollary |2.2l 

Theorem 3.1. Let Me, < t < r be dx d invertible integer matrices, and let ae, 
£ — 1, . . . ,r, be finitely supported masks. Let <j> be a nontrivial compactly supported 
function in L 2 (M. d ). Then the following conditions are equivalent. 
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FAR (Fast Adaptive Reconstruction) 



Parameters: 

• Number of iterations JgN. 

• Set of all indices C := |j/ =a Cf U (j/=i £ f • 

• Number of reconstructions rp for each position (3 £ £f-i, J — F . . . , J. 

• Separators between low- and high-pass parts sp < rp for each position 
0€£f_ 1 ,j = l,...,J. 

• Low- pass coefficients vp, where (3 £ £j. 

• High-pass coefficients wp, where j3 £ Uj=i £f ■ 

• Sequence of finitely supported masks ap £ Z(Z 2 ), (3 £ C, satisfying the 
conditions in Theorem 12. II 

• Sequence of matrices (Mp)p^c satisfying the conditions in Theorem 1 2. 11 
Recursive Algorithm: 

1) For j= J-l,...,0do 

2) For a £ Cf do 

3) Set v a = Y.pecf +1 a ^a ,Mp V l3 + S 7 e£f +1 a Sa^,M-, W T 

4) end; 

5) end; 
Output: 

• Data vq = Wm,. o) £ l{Z d ). 



Fig. 2.3. The FAR Algorithm for a fast adaptive reconstruction using affine-like systems. 



(i) For all v £ l{Z d ), 

r 

e=i 

(ii) For each f,g£ L 2 (R d ), 

r 

where 4>u a ;W is defined as in (PD andip 1 ,...,^ are de/med fry ip e (MjO := 
^ :=|det(M/)| ^ o/(k)^(Mi • -k). 

k6Z d 

Proof. We first recall that (i) is equivalent to (|2.1j) by Theorem l2.ll The strategy 
will now be to show that (ii) is equivalent to (|2.ip . 

We first assume that ^2TTJ holds. Then (/,0 Mo ;k} = (| det M | _1/2 /(Mo 0(- - 
k)) = (|detM o |" 1/2 /(Mo 1 -),0/ £i;k ). It is easy to sec that (|3~T|) holds if and only if it 
holds for Mo = Id- So, we assume that Mo = Id in the following proof. Using the 
Fourier-based approach as in |33( Lemma 3] , we have 

E^^X^k^) = (2n) d f J2 f(Om + 2vrk) + 27rk)d£ 
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and 



. r (3-2) 

/ E E /(OffK + 27r(Mf )" 1 k) ^(MfC)^(M^ + 27TRK. 



Since i^ e (MjO := «X£)<K£), we have 



^(MJ0^(M^ + 2nk) = ae(Oa e (Z + 2^ T 1 ^)^ + 2n(Mj ^k). 

Note that Z d is the disjoint union of Mjcu + MjZ d , ui G Om € - Now we deduce that 
(|3.2p becomes 

r 

E E^^M- 1:k XV'M-l;k'3) 

<=i kez d 

= (2ir) d f E E E /(OffK + 2ttw + 27rk) o/(0o/(e + 2™) 
• 4>(Q$(Z + 2ttuo + 27rk)^ 

= (2ir) d f E E /(0.9(£ + 27TW + 27rk) + + ^) 

i£{l<n<r : ojSOm„} 

Hence, ()3.1|i is equivalent to 



E /(Os«+27rk) 0(O0(e+27rk)de 

keZ d 

= / E E /(0^ + 27TW + 27Tk) + 27TW + 27Tk) 

Jv weaken 

E (£ + 2nu)d£. (3.3) 

^e{l<n<r : uef! Mn } 

Since (|2.ip holds, it is obvious that the above identity in f|3 . 3|) holds and therefore, 
(iii) holds. 

Conversely, if (ii) holds, then (|3.3[) holds. Now we use a similar argument as 
in [33[ Lemma 5] to prove that this implies condition (ii). For this, we note that 
fl + Z d := {lu + k : to G O, k G Z d } is a discrete set without any accumulation point. 
For any loq G fi and £o G R d , we can take any functions /, g G -L 2 (R d ) such that 
the support of / is contained inside -B e (£o) and the support of g is contained inside 
-B e (£ + 2ttujq). As long as e is small enough, it is not difficult to see that 



f + 27rk) = for all ke[0 + Z d ]\{u }. 
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Now it is easy to see that (|3.3p becomes 

= j f(OW + 2w )J(£)k£ + 2vrwo) ■ £ fi*(i)a<(£ + 27^)^. 

Rd £g{Kn<r:u£S! Mn } 

Note that <j!>(£) 7^ for almost every £ € M. Since the above identity holds for all 
functions /, g in L 2 (SL d ) as long as the support of / is contained inside -B e (£o) an( l 
the support of g is contained inside -B e (£ + 2-7rwo), we now easily deduce from the 
above identity that J2ee{i<n<r ■. u e!! M j + Stt^o) = £( w o) for almost every 

£ € B e (£o)- Since £0 can be arbitrary, we now conclude that (|2.1|) holds. 
The theorem is proved. □ 

If r = 1 and Mi = Id in Theorem 13.11 (ii), then we must have d\ = 1 (that is, 
a\ = S) and consequently for this particular case, T ai .i d v = v and S ai j d v = v, that 
is, the data is just copied. 

3.2. Tight Frame Structure. For any positive integer J, we now construct a 
tight affinc-like frame AS ,7 in L 2 (M. d ) corresponding to the decomposition and recon- 
struction algorithms, (FAD) (Figure [OJ) and (FAR) (Figure I2T5|) . respectively. Let 
a be a mask on Z rf and Mq he a d x d dilation matrix, for example, Mo = 2/^ and a 
is a tensor product mask. We assume that 

00 

0(£):=n«(«)"^)' 

i=i 

is a well-defined function in L 2 (M. d ) and we also assume that there exist filters bi, . . . , b r 
such that 



a(£)o(£ + 2ttw) + ^ 6<(0S(C + 2ttw) = w G ft Mo - 

£=1 

Based on these, we then define 

?(M^) := b e (OHO, l = l,...,r. 

Then the system 

forms a tight frame in L2(M. d ) by the Unitary Extension Principle of [12] (see also 

[3III33I13I). 

Next, we use this standard tight frame system to derive a new tight afhne-like 
frame AS,/ in L 2 (R d ) corresponding to the decomposition and reconstruction algo- 
rithms, (FAD) (FigureE21) and (FAR) (FigureESJ), respectively. 

First, denote 

v> (0 — 0) = <(>. 

Then, let /? G C^U\Jj =l Cf with f3 G £^ (1) , /3« G C$_ v or /? G £^ (1) , /3« G 
for some j G {1, . . . , J}. Then we recursively define affine functions by 
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Further, let (3^ G £ L _ 2 (2): etc. Using this sequence, we recursively define matrices 
by 

N<: M, : M ; : ..-M ; : : M : . 

We now define the associated affine-like system in the following way: 
Definition 3.2. Retaining the introduced notions and definitions, the affine-like 
system AS j is defined by 

AS j := {^. k , . . . ,^. k : 3 > J, k e Z d } U {^J Jjk : k e 7L\{1 e C L 7 U (j Cf}, 

3=1 

where we also employ the notation introduced in (jl.ip . 

We next show that this system - although in general not forming an orthonormal 
basis - still always constitutes a tight frame. 

Theorem 3.3. For any positive integer J, AS j is a tight frame for L 2 (M. d ). 

Proof. By Theorem 13. 1[ it is not difficult to deduce that 

E Ei(/'<M- k )i 2 = E Ek/<m ( ;X 

pecfucf kez d keZd 
Now from the above relation, we see that 

E E K/><M- k >i 2 = E K/>vfe ,0) >i 2 = E i(/>M- fc )i 2 . 

8ec L ,ull J , c H kez" 1 k6Z d kez d 

By our given assumption on <f> and ip 1 ,...,ip r , it is known that {4>M^-k '■ k G 
zd } U {-0f, 3 . : j > J, k e Z d , £ = 1, . . . , r} is a tight frame for L 2 (R d ). Consequently, 

00 r 

E E K/<M-k>i 2 + EE E k/.^i 2 = ii/ii^c-)- 

/3e£^uU/ =1 £f k 6 zd J= J fcl k e zd 

Hence, ASj is a tight frame for L 2 (R d ). □ 

Next we analyze the approximation order of the affine-like system ASj. For this, 
for r > 0, we recall that H T (M. d ) consists of all functions / £ L 2 (M. d ) satisfying 

We say that a mask a : Z d 1— > C has r sum rules if 

J2 o(n + M k)(n + Mok)' 3 = ^ a(M k)(M k) /3 

k6Z d keZ d 

for all n e Z d and for all (3 = (f3 u . . . , (3 d ) € (N U {0}) d such that < ft, . . . , [3 d < 

T,Pl + ---+P d <T. 

It follows from Theorem l3.3l that for any / E L 2 (M. d ), expanding / under the tight 
frame .45 j, we have 

00 r 

f = E E (f> ^M^k^NgM^k + E E E ^' ^Mj;k^Mj;k 

/3e£juU/ =1 cf kez d i=J fci kez d 
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with the series converging absolutely in L 2 (R d ). We now consider the truncated series 

Pj f-= E^'^M ';k^N 3 M ';k- 

By the same argument as in Theorem 13. 31 it is not difficult to deduce that 

Pjf = if, 0Ntf;k}0Ntf;k 

kez d 

The next theorem now follows from well-known results (see, e.g., [TS1 HH ISHl I3H I3S] 

and references therein). 

Theorem 3.4. Let AS j be the tight frame for L 2 (K d ) introduced in Definition 
\3. 21 Suppose that Mo is isotropic, that is, Mq is similar to a diagonal matrix with 
all entries having the same modulus. If the mask a has r sum rules, then AS j has 
approximation order r, that is, there exists a positive constant C such that 

11/ - P.if\\m^) < C\ det M r rJ/d |/l^(K*) for all f e H T (R d ), JeN. 



4. Shearlet Systems With an Associated AMRA. In this section, we will 
apply our general framework to the special case of shearlets. This leads to shearlet sys- 
tems, especially compactly supported ones, associated with an AMRA structure and 
fast decomposition and reconstruction algorithms. We anticipate that our considera- 
tions will improve the applicability of shearlets to various applications, in particular, 
frame based image restorations. 

We first present a very general construction, which - as shown in the second 
subsection - can be utilized to construct various shearlet systems with an associated 
AMRA and fast decomposition and reconstruction algorithms. Subsection 14.31 is then 
concerned with 3D shearlet constructions. 

4.1. General Construction of an AMRA. We first follow up on the com- 
ments after Corollary 12.21 in which it was pointed out that the construction of a 
sequence of dilation matrices M^, 1 < £ < r, i.e., invertible integer matrices and 
filters ai, £ = 1, . . . , r satisfying (|2.ip . depends only on the generated lattice M(Z d , 
1 < £ < r. Hence we first present a very general construction of such a sequence of 
matrices and filters provided that the matrices satisfy M^Z d = MZ d for all 1 < £ < r 
for some matrix M, which was the hypothesis of Corollary 12.21 

For this, we first fix a sublattice T of Z d . Obviously, there exist many d x d 
matrices M such that MZ d = T. We now construct a set of tight frame filters for such 
a lattice T so that 

r 

ai(£)ai(£, + 2W) = 6(oj), Luen M . (4.1) 

t=i 

As already mentioned before, the above equations in (|4. 1 [) only depend on £Im, which 
in turn only depend on the lattice MZ d = T. As showed in [291 Corollary 3.4], there 
exist two integer matrices E and F such that | det E\ = \ det F\ = 1 and 

M = EDF, £> = diag(di,...,d TO) !,...,!), di > . . .d TO > 1. 
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For the dilation matrix N := diag(di, . . . , d m ), we first construct a tensor product 
tight afhnc frame filter bank as follows. For each d„ > 1, one can easily construct a 
onc-dimcnsional tight affine frame filter bank ug , t = 1, . . . , r& n such that 

= S(cu), we {0, (4.2) 

For the construction of (compactly supported) one-dimensional tight affine frame 
filters, see [HI EH EJ [321 02] . 

Now we construct a tensor product filter bank by 

U(e u ...,e m )((3i, ■ ■ • ,/3d) ■= ut x {Pi) ■ ■ ■ue m (p m ), ft,...,fteZ. 

This generates a total of r := • . . . • r^ m filters. We reorder them as U\, . . . , U r . 
By (|4.2[) . one can easily check that 

U((0Ui(t + 2^) = 5(lu), £ G R d . 

Now wc define ai(£) := Ui{E T £), £ e M d , £ = 1, . . . , r. Then we have 

ai(t)ai(Z + 2mj) = 6(u), £ € R d . (4.3) 

In other words, using a tensor product construction, for any sublattice of % d generated 
by MZ d , we can easily obtain a set of (compactly supported) tight affine(-like) frame 
filters satisfying (|4.3[) . It is very important to notice that the above construction only 
depends on the lattice MZ d instead of the dilation matrix M itself. For more details 
on construction of high-dimensional wavelet filters using the tensor product methods, 

see [lain]. 

Next, we shall present a general construction of tight affine (-like) frame filters to 
fulfill the need in this paper. Suppose that we are given a group of dilation matrices 
Mi,£ = 1,...,?*. To achieve directionality, as discussed above, only the dilation 
matrices for the low-pass filters will be important. In other words, if shear matrices 
are involved, i.e., direction-based matrices, they play an important role for low-pass 
filter only and for high-pass filters, the choice of the dilation matrices does not matter, 
since no further decomposition will be performed for high-pass coefficients. 

We group these dilation matrices into subgroups according to their lattices MfZ d : 
if the lattices = Mg> are the same, then M^, are grouped into the same group. 
For each dilation matrix in a subgroup, we only use a fixed set of tight affine frame 
filters that are constructed for that lattice. In other words, for a given lattice, we 
have a set of tight affine frame filters and we have complete freedom in choosing the 
direction-based matrices, for instance, shear matrices, to achieve directionality as long 
as the resulting lattice is the same given lattice. 

Suppose now that we choose sets of such tight affine frame filters for all the 
groups of dilation matrices. Since these N sets of tight affine frames are completely 
independent, when we put them together to get one whole set of tight affine frame 
filters, we have to multiply the factor ^= to every involved filter in the set. Now it 
is straightforward to see that the total collection of all such N sets of renormalized 
tight affine frame filters indeed forms a collection of tight affine frame filters satisfying 
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()2.ip , where r is the total number of all the involved filters. It is also very important 
to notice that the renormalization of the filters does not reduce the directionality of 
the tight affine frame system, since the coefficients in the same band has the same 
ordering of magnitude as the one without renormalization. 

4.2. Shearlet Constructions. We next focus on explicit shearlet constructions. 
For this, we recall that the dilation for shearlets is composed of a shear matrix S s 
and a parabolic scaling matrix A c (cf. Subsection ll.3[) . Thus, at each level of the 
decomposition, the matrices will be chosen as 

M e = S e A 4 , (4.4) 

for some shear matrices Se whose selection should be driven by the particular appli- 
cation at hand, and A^ is the parabolic scaling matrix, where the choice of the value 4 
(in contrast to 2) avoids technicalities caused by square roots. As already elaborated 
upon before, which of those matrices will be labeled low- and which one high-pass is 
left to the user. 

4.2.1. Shearlet Unitary Extension Principle and Fast Shearlet Trans- 
form. The requirements on the filters associated with general matrices of the type 
described in (|4.4p at each level were already derived in Theorem 1 1.1[ which we coined 
the 'Shearlet Unitary Extension Principle'. 

Aiming towards examples for possible filters, we first observe that there exists 
only two different lattices in Theorem 11.11 Consider the product SeA^ with Si = 

If si is an even integer, then SeAiJ? = A4Z 2 , if it is an odd integer, 

then Se A4J? = SA4Z 2 with S = ^ ^\ . Hence we only need to design two sets of 

tight shearlet frame filters in advance for the lattices A^I? and SA4Z 2 , respectively, 
following the general construction in Subsection l4.11 Then we have complete freedom 
in choosing the shear matrices St to obtain a whole set of tight shearlet frame filters 
satisfying perfect reconstruction (see condition (i) in Theorem II .lj) . In particular, 
notice that we can choose the filters such that the designed tight shearlet frame is 
compactly supported, for example, take Mo = 2/2 and choose the tensor product ID 
tight wavelet frames derived from the linear hat function as constructed in |42j . 

Each such a choice of filters for each level then leads to a Fast Adaptive Shearlet 
Decomposition associated with a Fast Adaptive Shearlet Reconstruction. Those two 
algorithms are described in Figures 14.11 and 14.21 Notice that here - as already in the 
general version of (FAD) and (FAR) - the shear matrices can be chosen differently 
at each level of the decomposition. We can envision that this adaption can be made 
flexible dependent on a quick analysis, thresholding, say, of the data outputted in the 
previous decomposition step. The algorithm leaves all those possibilities open. The 
great flexibility provided here should be utilizable for various applications including, 
in particular, frame based image restorations. 

4.3. 3D Shearlets. Various applications such as the problem of geometric sepa- 
ration in image processing, for example, in astronomy when images of galaxies require 
separated analyzes of stars, filaments, and sheets call for directional representation 
systems for 3D data (see, e.g., (20l[2T|). In this subsection, we will show that our 
framework conveys the potential to generate (compactly supported) shearlets for 3D 
signals alongside a fast flexible decomposition strategy. 
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FASD (Fast Adaptive Shearlet Decomposition) 

Parameters: 

• Data v el(Z 2 ). 

• Number of iterations J G N. 

• Set of all indices C := |j/ = i £j U U/=i £f • 



Number of decompositions rp for each position (3 G £^-i) j = 1, • • ■ ,J- 
Separators between low- and high-pass parts sp < rp for each position 
pe£f_ 1 ,j = l,...,J. 

• Sequence of finitely supported masks ap G j3 G £, satisfying the 
conditions in Theorem ll.il 

• Sequence of shear matrices (Sp)p e c satisfying the conditions in Theorem 

Algorithm: 

1) Set v = U(o,...,o) = v - 

2) For j = 1, . . . , J do 

3) For /3 G a G £jLj do 

4) Set V(i = Ta^SpAiVa. 

5) end; 

6) For /3 G £f a , a G L L _ X do 

7) Set = Ta^s^Va- 

8) end; 

9) end; 
Output: 

• Low- pass coefficients v@, where j3 G £j. 



High-pass coefficients u;^, where /3 G Ufci 



Fig. 4.1. The FASD Algorithm for a fast adaptive decomposition using shearlet systems. 



In fact, our framework also provides shearlets associated with an AMRA structure 
in higher dimensions. However, for the purpose of clarity we will focus on dimension 
3. One possibility to extend the parabolic scaling is by defining 

/ c \ 
A c = yfc ,c>0. (4.5) 

V o o / 

General shear matrices were for instance studied in [26| . But in order to present the 
idea for a 3D shearlet construction and don't cloud it with technicalities, the shear 
matrices introduced in [17] shall serve as an interesting example, and we define 




S SltS2 =10 1 , ( Sl ,s 2 ) GM 2 . (4.6) 



We now set = SiA^, for some shear matrices Si of type (|4.6p . whose selection 
should be driven by the particular application at hand, and A4 is the parabolic scaling 
matrix from (|4.5|) . 

Concerning a construction of filters, we can again employ the general construction 
from Subsection 14. II By calculation, it is easy to see that we have only four different 
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FASR (Fast Adaptive Shearlet Reconstruction) 

Parameters: 

• Number of iterations JgN. 

• Set of all indices C := |j/ =a Cf U (j/=i £ f • 

• Number of reconstructions rp for each position (3 £ £f-i, J — 1, . . . , ^7. 

• Separators between low- and high-pass parts sp < rp for each position 
0€£f_ 1 ,j = l,...,J. 

• Low- pass coefficients vp, where (3 £ £j. 

• High-pass coefficients wp, where j3 £ Uj=i £f ■ 

• Sequence of finitely supported masks ap £ Z(Z 2 ), (3 £ C, satisfying the 
conditions in Thcorcm ll.il 

• Sequence of shear matrices {Sp)p^c satisfying the conditions in Theorem 

o 

Recursive Algorithm: 

1) For j = J- 1,.. .,0 do 

2) For a £ Cf do 

3) Set V a = 52p eC L +i a Sa^SpAiVp + J2 7 ecf +l a Sa^At^V 

4) end; 

5) end; 
Output: 

• Data W(o,....o) € l{^ d )- 



Fig. 4.2. T/ie FASR Algorithm for a fast adaptive reconstruction using shearlet systems. 

sets of sublattices, according to even or odd s\ and S2- Using tensor products, we can 
design four sets of tight affinc frame filters in advances. Then we have the complete 
freedom in choosing the shear matrices S' sljS2 to obtain a whole set of tight frame 
filters. 

We would like to mention that although focussing on 3D in this subsection, our 
framework can also be used to generate shearlet systems in higher dimensions using 
the general definition of shear matrices in |26| . The parabolic scaling can be extended 
to higher dimension, for instance, as it was done in [17] . but various other choices are 
possible, which will be explored in future work. 

5. Further Examples of Directional Systems associated with an AMRA. 

To show the broad applicability of the AMRA-structure, in this section, we will present 
further examples of systems which have the potential to analyze the directional con- 
tent of images and signals. 

5.1. Shearlet-Like Construction. The resolution of anisotropic structures re- 
quires paramatrization of directions. The most natural way seems to be the choice 
of parametrization through angles. However, angles are related with the rotation op- 
erator, which is incompatible with digital lattices. This observation led to the intro- 
duction of shcarlets, which measure directionality by slope rather than angle thereby 
greatly supporting the treating of the digital setting. However, it seems natural to 
seek for more general operators which leave lattice structures invariant while being 
somewhat close to rotation. These might differ from the shear matrices utilized in the 
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shearlct definition, and provide an improvement on uniform treatment of all angles. 
We would like to remind the reader that in the shearlet construction (cf. Subsection 
II. 3|) the partition into cones serves as a means to allow a more uniform treatment of 
the angles, since the 'pure' shearlct system generated by the shearlet group is strongly 
biased towards one axis (for more details we refer the interested reader to [24]). 
We can model this optimization problem in the following way: 



(Rot ) B e = argmin B 



GM(Z,2) 



2 71 



\(Re-B) 



cost 
sini 



\dt s.t. det(-B) = 1, 



where Re, 8 € [0, 2ir) is planar rotation by 8 radians. 

This optimization problem can be explicitly solved, which is done in the following 
result: 

Theorem 5.1. For 8 e [0, 2tt), we denote the solution of (ROTg) by Be- Then 



Be = { 



I 

S-\ or Si 
orS[ 2) 



,(D 



5* 



(i) 



? (2) 



-Si or — 5^1 



2n — arcsin(i) < 8 < arcsin(i), 
arcsin(i) < 6 < \ , 
| < 6 < arccos(i), 
arccos(i) < 8 < it — arccos(i), 
7r - arccos(i) < 8 < ^ 



■■',77 



< 8 < it — arcsin(i). 



The remaining six cases can be determined by transposition of the previous matrices, 
in particular. 



Be = < 



-I 

—Sf or — SLi 
(S^ or (S^l) T 

(S^f or (S (2) ) T 
S^i or Si 



7r — arcsin(i) < 8 < ir + arcsin(|), 



7T - 
Sir 



-arcsin(f) <6<^f, 
< 8 < 7r + arccos(i), 

3tt 

'2' x " - 2 

+ arcsin(i) <8< 7 -f, 
4 1 < 8 < 2tt- arcsin(i), 



7T + arccos(i) < 8 < 4f + arcsin(i), 



where 



S?> = 



id s& = 



Proof. Set B = (6y)i<i,j<2- First, 
cosi 



\{Re-B) 



sini 



[(cos 8 - 6n) 2 + (sin 8 - b 2 i) 2 } cos 2 t + [(- sin 8 - b 12 ) 2 + (cos 8 - b 22 ) 2 } sin 2 t 
+2[(cos# — &n)(— sin£> — 612) + (sin8 — b 2 i)(cos8 — b 22 )] cost s'mt. 



Hence 



\(Re-B) 



cost 
sint 



\\dt 



7r[(cos6» - &n) 2 + (-sin 8 - b 12 ) 2 + (sin0 - b 21 ) 2 + (cos(9 - b 22 ) 2 }. 
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We now aim to minimize the term on the RHS over 611,612,621,622 G Z under the 
constraint that det B = 1 . Certainly, the solution to 

min [( C os6'-6 1 i) 2 + (-sin6l-6i2) 2 + (sin6l-62i) 2 + (cos6l- 62 2 ) 2 ], (5.1) 

B=(6y) 4li eM(Z,2) 

by denoting the elements in Rg by rf^, is 

6 y = ro\md(rfj) for all i, j G {1,2}. 

where round(-) is the classical rounding to the nearest integer. Notice that fry G 
{ — 1,0,1}. The next closest solution (possibly not unique) can be determined by 
choosing io,jo G {1,2} such that 

||round« JO ) - < Jo || 2 > ||round(ry - r^|| 2 for all i,j G {1, 2}. 

Then choose 




sgn(6 loJO )-l : round(6; OJO ) = 0, 
: round(6 ioJO ) ^ 



and 



bij = round(r li ) for all ^ (i ,jo)- 

In fact, we will see that provided the solution to (|5.ip does not satisfies the constraint 
det-B = 1, then the just described closest one does, hence is a solution of (ROT0). 
We now consider the case < 8 < ^ . The other cases can be handled similarly. 
• If < 6 < arcsin _1 (i), then the closest solution is Rg, which satisfies the 
constraint. 



If arcsin 1 (i) < 9 < arccos : (|), then the solution to (|5.1|) is 

*-(! -\ 

for which det A = 2. The closest one to this - as just described - is 
B=l! lUf! M for0<l, 

and 

, ^ , , 

1 1 J \ 1 J - 4' 

These integer matrices obviously satisfy the constraint det B = 1 . 

• If arccos -1 (i) < 8 < then the closest solution is Rg, which satisfies the 
constraint. 
This proves the theorem. □ 

It is interesting to notice that all these matrices are in fact shear matrices or 
closely related to shear matrices. 



1 I V 1 1 I ^4 



B= ° 1 or } -M for^>^ 
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This consideration now enables us to propose a shearlct-like system with pre- 
sumable improved uniformity of the treatment of all angles. For this, we let 9g, 
£ = 1, . . . , 12 be representatives of the angles giving rise to the twelve different cases 
discussed in Theorem 15. II We choose 

M e = B 9i A 4 , i=l,...,12, 

for each level leaving the 'cut' between low- and high-pass parts to the user. The 
sequence of associated filters ae , £ = 1, ■ ■ ■ , 12 can be chosen similarly as in Section 0] 

5.2. An Isotropic System for detecting Anisotropic Phenomena. The 

following is some explanation for the tight frame in Definition 13.21 about how we can 
achieve directionality by using the simplest system: dilation M = 2I2 and tensor 
product filters, but using shear matrices in the middle. It is very important to notice 
that for this case, the construction of all the filters in Corollary 12. 21 (ii) is independent 
of the choice of the shear matrix. This simple fact has been noticed in [29j and makes 
the construction of multivariate wavelets very simple. 

From now on, we assume that M is fixed (say, M = 21 d) and all filters are obtained 
by a tensor product construction. Therefore, these filters give preferences to horizontal 
and vertical direction. In other words, they are suitable for handling only edges having 
either horizontal or vertical orientation. 

Let us look at the elements in ASj introduced in Definition 13. 21 For the functions 
in level 1, we have a <G Cf U £f , that is, a = (£,0,...,0) with < £ < r a . Then 

^ a (M^M J • -n) = I dct(M Q )| « Q (k)0(M o 7 • -M Q n - k) 

k<EZ d 

= |det(Mo)|(a Q *^)(M 7 --M Q n). 

Note that ip^ M J -n w ^ n a high-pass filter has the same directionality as the filter ap, 
that is, only either horizontal or vertical direction. Note that we assume to have 
horizontal or vertical directionality for high-pass filters only, while for low-pass filters, 
we assume that they are isotropic and there is no directionality for them. In other 
words, for low-pass filters, the filters have no directionality. 

The directionality comes at the next level starting with level 2. For (3 € L\ € , 
we have /3 = a + {0,1, 0, . . . , 0) with a e Cf and < £ < r> Note N = M^M" 1 . So, 

^Ntf;- are S iven ^ 

<M ';n = ^(M^M-X ■ -n) = I det(M )| £ a^k^M" 1 !^ . -M^n - k). 

That is, we similarly have 

<M ';n = I det(M )|(a 3 * ^(M" 1 !^ • -M^n). 
To see the directionality better, we rewrite it in terms of <f> as follows: 
<M-n = I dct ( M o)l E MWM-X 7 ' -M^n - k) 

= I det(M )| 2 E a p {k)(a a * 0)(M^ • -M^M^n - M Q k). 

kGZ d 
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To see the directionality of ip^ m j t' ^ suffices to sec it for n = 0, since all others arc 
just shifts of n = (that is, they have the same directionality). In this case, 

<m-o = I det(M )| 2 J2 *0)(M O 7 ■ -M a k). 

keZ d 

Note that a a is a low-pass filter and therefore, it has no directionality. In other words, 
the function a a *4> has most of its energy concentrated about the origin. Though Mq 
can also yield directionality by rotating the function, let us ignore this possibility here 
and simply assume that Mo = 21 d (or even simply take J = 0). 

Now let us argue that if ap, as a high-pass filter, has directionality either in the 
horizontal or vertical direction, then the function tb^. „ , , „ will have directionality other 

' 1 Npj MfJ ;0 J 

than horizontal and vertical, induced by M Q = S^Mo, where S a is some shear matrix. 
For simplicity, we assume ap is a filter with horizontal directionality. Therefore, ap(k) 
concentrates most of its energy for k on/around the x-axis. But the energy of the 
term (a a *<l>) (Mq ■ — M a k) concentrates around the point Mq~ M a k. Therefore, for k = 
(k, 0, . . . , 0) with k e Z (this is the line where most energy of ap is concentrating), the 
energy location for ^ m j. m above sum is put at the location MQ J M a k = Mq~ j S a k 

instead of MQ~ J k. In other words, the energy of the function V^ M ./. is aligned around 

the straight line: the image of the x-axis under the mapping Mq~ j S q,. Since S a acts 
like a rotation, the directionality is controlled by this mapping; the horizontal and 
vertical lines are mapped into other directions. By using different S a (such as the 
power of some shear matrices), as many directions as required by the application at 
hand can be created. 
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